Skip to content

Improve error logging when invalid number of tokens is requested.#3680

Open
yobibyte wants to merge 1 commit intoNVIDIA:mainfrom
yobibyte:vitalyk/loggingerr
Open

Improve error logging when invalid number of tokens is requested.#3680
yobibyte wants to merge 1 commit intoNVIDIA:mainfrom
yobibyte:vitalyk/loggingerr

Conversation

@yobibyte
Copy link
Contributor

@yobibyte yobibyte commented Mar 3, 2026

Log actual error that happens on the inference server to help with the debugging. Right now it is impossible to change your hyperparameters / understand the actual reason of the failure.

@yobibyte yobibyte requested review from a team as code owners March 3, 2026 18:25
@svcnvidia-nemo-ci svcnvidia-nemo-ci requested a review from a team March 3, 2026 18:25
@svcnvidia-nemo-ci svcnvidia-nemo-ci added this to the Core 0.16 milestone Mar 3, 2026
@yobibyte yobibyte changed the title Add more logs. Improve error logging when invalid number of tokens is requested. Mar 3, 2026
@Phlip79 Phlip79 added Expert Review Apply this label to indicate that your PR is ready for expert review. complexity: low labels Mar 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

complexity: low Expert Review Apply this label to indicate that your PR is ready for expert review.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants